IN THE CLAIMS: 

Please amend Claims 1-14, 16-22, and 26. The following is a complete 
listing of the claims, and replaces the original claims of the present application filed 
herewith. 

Claim 1 (currently amended): An image processing device comprising: 

an image pick-up device having the fixed positional relation with a 
measurement object; 

an attitude sensor for measuring the attitude at an image pick-up visual 
point of said image pick-up device; 

a storage means for storing unit adapted to store the calculation information 
to calculate the attitude and/or position of said measurement object on the basis of an 
output from said attitude sensor; 

a target image setting m e ans fo r setting unit adapted to set a target image 
that is an object for detecting a predetermined index on the basis of a picked-up image 
picked up by said image pick-up device; 

a detecting means for detecting unit adapted to detect the position of said 
index in said target image by performing a template matching process between a template 
image of said index and said target image; 

an updating means for updating unit adapted to update said calculation 
information stored in said storage [[means]] unit on the basis of a detected position of said 
index detected by said detecting [[means]] unit; and 
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a calculation means fo r calculating unit adapted to calculate the attitude 
and/or position of said measurement object on the basis of said measured value and said 
calculation information updated by said updating [[means]] unit . 

Claim 2 (currently amended): The image processing device according to 
claim 1, wherein said target image setting [[means]] unit obtains a prediction position of 
the index in said picked-up image employing said measured value and said calculation 
information stored in said storage [[means]] unit, creates an image with a peripheral area 
around said prediction position in said picked-up image subjected to a rotational process on 
the basis of a rotational angle in a roll direction of said image pick-up device derived from 
said measured value, and outputs said image as a target image. 

Claim 3 (currently amended): The image processing device according to 
claim 2, wherein said calculation information is the correction information to correct for an 
error in the measured value of attitude measured by said attitude sensor, and said 
calculation [[means]] unit calculates the attitude of said measurement object on the basis of 
said measured value and said correction information. 

Claim 4 (currently amended): The image processing device according to 
claim 1, wherein said calculation information is the correction information to correct for an 
error in the measured value of attitude measured by said attitude sensor, and said 
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calculation [[means]] unit calculates the attitude of said measurement object on the basis of 
said measured value and said correction information. 

Claim 5 (currently amended): The image processing device according to 
claim 1 [[or 2]], wherein said calculation information is the correction information to 
correct for an error in the measured value of attitude measured by said attitude sensor and 
the position information of the image pick-up visual point of said image pickup device, and 
said calculation [[means]] unit calculates the position and attitude of said measurement 
object on the basis of said measured value, said correction information and said position 
information. 

Claim 6 (currently amended): The image processing device according to 
claim 1 [[or 2]], wherein said calculation information is the position information of the 
image pick-up visual point of said image pickup device, and said calculation [[means]] unit 
calculates the position and attitude of said measurement object on the basis of said 
measured value and said position information. 

Claim 7 (currently amended): The image processing device according to 
claim 5 [[or 6]], wherein said updating [[means]] unit updates the position information in 
the two directions except for a depth direction in the camera coordinate system of said 
image pickup device, even when an index of only a single point is detected in said 
detecting [[means]] unit . 
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Claim 8 (currently amended): The image processing device according to 
any on e of claims 3 to 5 claim 3 , wherein said correction information is the information to 
correct for an error in the azimuth direction among the measured values of the attitude 
measured by said attitude sensor. 

Claim 9 (currently amended): The image processing device according to 
any one of claims 3 to 5 claim 1 , wherein said updating [[means]] unit updates said 
calculation information on the basis of the detected position of said index in said picked-up 
image. 

Claim 10 (currently amended): The image processing device according to 
claim 3 , 4 o r 6 , wherein said updating [[means]] unit updates said calculation information 
on the basis of a typical value of the updated value of said calculation information obtained 
for each index when a plurality of indices are detected in said detecting [[means]] unit . 

Claim 1 1 (currently amended): The image processing device according to 
claim 3, wherein said updating [[means]] unit updates said calculation information on the 
basis of a dislocation between the prediction position and said detected position of said 
index in said target image. 

Claim 12 (currently amended): The image processing device according to 
claim 11, wherein said updating [[means]] unit updates said calculation information on the 
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basis of a typical value of said dislocation obtained for each index when a plurality of 
indices are detected in said detecting [[means]] means . 



Claim 13 (currently amended): The image processing device according to 
any one of claims 5 to 7 claim 5 , wherein said updating [[means]] umt updates the position 
information in three directions in the camera coordinate system of said image pick-up 
device, when two or more indices are detected in said detecting [[means]] unit . 

Claim 14 (currently amended): The image processing device according to 
any one of claims 1 to 13 claim 1 , wherein said index is a projected image of a landmark in 
the real space onto said picked-up image. 

Claim 15 (original): The image processing device according to claim 14, 
wherein the position of said landmark in the real space is known. 

Claim 16 (currently amended): The image processing device according to 
claim 4 , 11 or 12 , wherein said index is an image feature on said picked-up image. 

Claim 17 (currently amended): The image processing device according to 
any one of claims 1 to 16 claim 1 , wherein said measurement object is an image pick-up 
visual point of said image pick-up device. 
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Claim 18 (currently amended): The image processing device according to 
claim 17, further comprising display [[means]] unit for displaying said picked-up image 
with the image in the virtual space superposed thereon on the basis of the attitude, or 
position and attitude of said image pick-up device calculated by said calculation [[means]] 
unit . 

Claim 19 (currently amended): The image processing device according to 
any one of claims 1 to 16 claim 1 , wherein said measurement object is a visual point of the 
observer, and said image processing device further comprises display [[means]] unit for 
displaying the image in the virtual space drawn on the basis of the attitude or position and 
attitude of the observer calculated by said calculation [[means]] unit on said display screen, 
while optically transmitting the image in the real space through said display screen 
observed by the observer. 

Claim 20 (currently amended): An image processing device in which the 
position of an index in a picked-up image picked up by an image pick-up device is detected 
by template matching employing a template image of said index, comprising: 

an attitude sensor for measuring the attitude at an image pick-up visual 
point of said image pick-up device; 

a target image creating means for c r eating unit adapted to create a target 
image having a peripheral area around a prediction position in said picked-up image 
subjected to a rotational process on the basis of the rotational angle in a roll direction from 
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said measured values by obtaining said prediction position of the index in said picked-up 
image, employing the measured value of said attitude measured by said attitude sensor, and 
outputting the target image; and 

a detecting means fo r detecting unit adapted to detect the position of said 
index in said picked-up image by performing a template matching process between said 
template image and said target image. 

Claim 21 (currently amended): The image processing device according to 
any one of claims 1 to 20 claim 1 , further comprising a template image creating means for 
creating unit adapted to create a template image for detecting said index from the image, 
wherein said template image creating [[means]] unit specifies the position of the index in 
the picked-up image when said image pickup device is located at a predetermined position 
and attitude and creates a template image of the index with a peripheral area around the 
position of the index in said picked-up image subjected to a rotational process on the basis 
of the rotational angle in a roll direction from said predetermined positional attitude. 

Claim 22 (currently amended): The image processing device according to 
any one of claims 1 to 21 claim 1, wherein said attitude sensor measures the attitude of an 
image pick-up visual point of said image pick-up device in a state where there is an 
accumulated error in the measured value in the azimuth direction. 
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Claim 23 (original): The image processing device according to claim 22, 
wherein said attitude sensor is constituted of a gyro sensor. 

Claim 24 (original): An image processing method comprising: 

an image pick-up step of picking up an image with an image pick-up device 
having the fixed positional relation with a measurement object; 

an attitude measuring step of measuring the attitude at an image pick-up 
visual point of said image pick-up device; 

a storage step of storing the calculation information to calculate the attitude 
and/or position of said measurement object on the basis of the measured value measured at 
said attitude measuring step; 

a target image setting step of setting a target image that is an object for 
detecting a predetermined index on the basis of said picked-up image; 

a detecting step of detecting the position of said index in said target image 
by performing a template matching process between a template image of said index and 
said target image; 

an updating step of updating said calculation information stored at said 
storage step on the basis of a detected position of said index detected at said detecting step; 
and 

a calculating step of calculating the attitude and/or position of said 
measurement object on the basis of said measured value and said calculation information 
updated at said updating step. 



Claim 25 (original): The image processing method according to claim 23, 
wherein said target image setting step comprises creating a target image with a peripheral 
area around a prediction position in said picked-up image subjected to a rotational process 
on the basis of the rotational angle in a roll direction of said image pick-up device derived 
from said measured value by obtaining said prediction position of the index in said 
picked-up image, employing the measured value and the calculation information stored at 
said storage step. 

Claim 26 (currently amended): A program code for executing the image 
processing method according to claim 24 [[or 25]]. 

Claim 27 (original): A storage medium storing the program code according 

to claim 26. 
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